Dataset Profiling Report

Dataset statistics

Number of variables	9
Number of observations	2000
Missing cells	1660
Missing cells (%)	9.2%
Duplicate rows	1256
Duplicate rows (%)	62.8%
Total size in memory	140.8 KiB
Average record size in memory	72.1 B

Variable types

NUM	8
BOOL	1

Warnings

Dataset has 1256 (62.8%) duplicate rows	Duplicates
`BloodPressure` has 90 (4.5%) missing values	Missing
`SkinThickness` has 573 (28.6%) missing values	Missing
`Insulin` has 956 (47.8%) missing values	Missing
`BMI` has 28 (1.4%) missing values	Missing
`Pregnancies` has 301 (15.0%) zeros	Zeros

Reproduction

Analysis started	2020-09-07 14:59:39.582410
Analysis finished	2020-09-07 14:59:48.504680
Duration	8.92 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

Pregnancies
Real number (ℝ_≥0)

ZEROS

Distinct	17
Distinct (%)	0.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.7035
Minimum	0
Maximum	17
Zeros	301
Zeros (%)	15.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	3
Q3	6
95-th percentile	10
Maximum	17
Range	17
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	3.306063033
Coefficient of variation (CV)	0.8926861166
Kurtosis	0.409867576
Mean	3.7035
Median Absolute Deviation (MAD)	2
Skewness	0.9823655943
Sum	7407
Variance	10.93005278
Monotocity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
1	356	17.8%
0	301	15.0%
2	284	14.2%
3	195	9.8%
4	191	9.6%
5	141	7.0%
6	131	6.6%
7	100	5.0%
8	96	4.8%
9	70	3.5%
Other values (7)	135	6.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	301	15.0%
1	356	17.8%
2	284	14.2%
3	195	9.8%
4	191	9.6%

Value	Count	Frequency (%)
17	3	0.1%
15	2	0.1%
14	7	0.4%
13	22	1.1%
12	23	1.1%

Glucose
Real number (ℝ_≥0)

Distinct	135
Distinct (%)	6.8%
Missing	13
Missing (%)	0.6%
Infinite	0
Infinite (%)	0.0%

Mean	121.9753397
Minimum	44
Maximum	199
Zeros	0
Zeros (%)	0.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	44
5-th percentile	80
Q1	99
median	117
Q3	141
95-th percentile	181
Maximum	199
Range	155
Interquartile range (IQR)	42

Descriptive statistics

Standard deviation	30.63288283
Coefficient of variation (CV)	0.2511399673
Kurtosis	-0.3598027486
Mean	121.9753397
Median Absolute Deviation (MAD)	20
Skewness	0.5113063262
Sum	242365
Variance	938.3735104
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
99	49	2.5%
100	44	2.2%
102	39	1.9%
129	37	1.8%
106	36	1.8%
112	36	1.8%
95	36	1.8%
105	34	1.7%
120	33	1.7%
111	33	1.7%
Other values (125)	1610	80.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
44	2	0.1%
56	3	0.1%
57	5	0.2%
61	3	0.1%
62	2	0.1%

Value	Count	Frequency (%)
199	3	0.1%
198	2	0.1%
197	8	0.4%
196	5	0.2%
195	8	0.4%

BloodPressure
Real number (ℝ_≥0)

MISSING

Distinct	46
Distinct (%)	2.4%
Missing	90
Missing (%)	4.5%
Infinite	0
Infinite (%)	0.0%

Mean	72.40366492
Minimum	24
Maximum	122
Zeros	0
Zeros (%)	0.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	24
5-th percentile	52
Q1	64
median	72
Q3	80
95-th percentile	90
Maximum	122
Range	98
Interquartile range (IQR)	16

Descriptive statistics

Standard deviation	12.22796763
Coefficient of variation (CV)	0.1688860315
Kurtosis	0.9011263224
Mean	72.40366492
Median Absolute Deviation (MAD)	8
Skewness	0.2101691174
Sum	138291
Variance	149.5231924
Monotocity	Not monotonic

Histogram with fixed size bins (bins=46)

Value	Count	Frequency (%)
74	145	7.2%
70	144	7.2%
78	128	6.4%
68	125	6.2%
64	120	6.0%
72	118	5.9%
80	98	4.9%
62	94	4.7%
76	93	4.7%
60	92	4.6%
Other values (36)	753	37.6%
(Missing)	90	4.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
24	2	0.1%
30	3	0.1%
38	3	0.1%
40	2	0.1%
44	11	0.5%

Value	Count	Frequency (%)
122	3	0.1%
114	3	0.1%
110	7	0.4%
108	5	0.2%
106	9	0.4%

SkinThickness
Real number (ℝ_≥0)

MISSING

Distinct	52
Distinct (%)	3.6%
Missing	573
Missing (%)	28.6%
Infinite	0
Infinite (%)	0.0%

Mean	29.3412754
Minimum	7
Maximum	110
Zeros	0
Zeros (%)	0.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	7
5-th percentile	13
Q1	22
median	29
Q3	36
95-th percentile	46
Maximum	110
Range	103
Interquartile range (IQR)	14

Descriptive statistics

Standard deviation	10.80227753
Coefficient of variation (CV)	0.368159781
Kurtosis	5.810887312
Mean	29.3412754
Median Absolute Deviation (MAD)	7
Skewness	1.081610466
Sum	41870
Variance	116.6891998
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
32	83	4.2%
30	75	3.8%
23	60	3.0%
27	58	2.9%
28	54	2.7%
18	54	2.7%
39	52	2.6%
33	51	2.5%
31	50	2.5%
25	47	2.4%
Other values (42)	843	42.1%
(Missing)	573	28.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
7	3	0.1%
8	6	0.3%
10	13	0.7%
11	14	0.7%
12	21	1.1%

Value	Count	Frequency (%)
110	2	0.1%
99	2	0.1%
63	3	0.1%
60	2	0.1%
59	2	0.1%

Insulin
Real number (ℝ_≥0)

MISSING

Distinct	181
Distinct (%)	17.3%
Missing	956
Missing (%)	47.8%
Infinite	0
Infinite (%)	0.0%

Mean	153.743295
Minimum	14
Maximum	744
Zeros	0
Zeros (%)	0.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	14
5-th percentile	42
Q1	76.75
median	126
Q3	190
95-th percentile	391.25
Maximum	744
Range	730
Interquartile range (IQR)	113.25

Descriptive statistics

Standard deviation	111.2736394
Coefficient of variation (CV)	0.7237625509
Kurtosis	4.483723806
Mean	153.743295
Median Absolute Deviation (MAD)	54
Skewness	1.890093303
Sum	160508
Variance	12381.82282
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
105	31	1.6%
140	24	1.2%
180	23	1.1%
130	22	1.1%
120	21	1.1%
100	20	1.0%
76	17	0.9%
135	17	0.9%
94	17	0.9%
66	15	0.8%
Other values (171)	837	41.9%
(Missing)	956	47.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
14	3	0.1%
15	3	0.1%
16	3	0.1%
18	5	0.2%
22	3	0.1%

Value	Count	Frequency (%)
744	2	0.1%
680	2	0.1%
600	2	0.1%
579	4	0.2%
545	2	0.1%

BMI
Real number (ℝ_≥0)

MISSING

Distinct	246
Distinct (%)	12.5%
Missing	28
Missing (%)	1.4%
Infinite	0
Infinite (%)	0.0%

Mean	32.65010142
Minimum	18.2
Maximum	80.6
Zeros	0
Zeros (%)	0.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	18.2
5-th percentile	22.2
Q1	27.5
median	32.4
Q3	36.8
95-th percentile	45.2
Maximum	80.6
Range	62.4
Interquartile range (IQR)	9.3

Descriptive statistics

Standard deviation	7.241027268
Coefficient of variation (CV)	0.2217765628
Kurtosis	2.784217688
Mean	32.65010142
Median Absolute Deviation (MAD)	4.7
Skewness	0.9290429988
Sum	64386
Variance	52.43247589
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
31.2	33	1.7%
32	33	1.7%
31.6	29	1.5%
33.3	27	1.4%
32.8	25	1.2%
32.4	25	1.2%
32.9	24	1.2%
30.8	24	1.2%
30.1	22	1.1%
29.7	22	1.1%
Other values (236)	1708	85.4%
(Missing)	28	1.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
18.2	8	0.4%
18.4	2	0.1%
19.1	2	0.1%
19.3	3	0.1%
19.4	2	0.1%

Value	Count	Frequency (%)
80.6	2	0.1%
67.1	3	0.1%
64.4	2	0.1%
59.4	3	0.1%
57.3	3	0.1%

DiabetesPedigreeFunction
Real number (ℝ_≥0)

Distinct	505
Distinct (%)	25.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.47093
Minimum	0.078
Maximum	2.42
Zeros	0
Zeros (%)	0.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	0.078
5-th percentile	0.141
Q1	0.244
median	0.376
Q3	0.624
95-th percentile	1.136
Maximum	2.42
Range	2.342
Interquartile range (IQR)	0.38

Descriptive statistics

Standard deviation	0.3235525587
Coefficient of variation (CV)	0.687050217
Kurtosis	5.006839839
Mean	0.47093
Median Absolute Deviation (MAD)	0.168
Skewness	1.811978894
Sum	941.86
Variance	0.1046862582
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.258	16	0.8%
0.207	15	0.8%
0.268	13	0.7%
0.292	13	0.7%
0.261	13	0.7%
0.238	13	0.7%
0.52	13	0.7%
0.284	12	0.6%
0.551	12	0.6%
0.259	12	0.6%
Other values (495)	1868	93.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.078	2	0.1%
0.084	2	0.1%
0.085	5	0.2%
0.088	6	0.3%
0.089	2	0.1%

Value	Count	Frequency (%)
2.42	3	0.1%
2.329	2	0.1%
2.137	3	0.1%
1.893	2	0.1%
1.781	2	0.1%

Age
Real number (ℝ_≥0)

Distinct	52
Distinct (%)	2.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	33.0905
Minimum	21
Maximum	81
Zeros	0
Zeros (%)	0.0%
Memory size	15.6 KiB

Quantile statistics

Minimum	21
5-th percentile	21
Q1	24
median	29
Q3	40
95-th percentile	58
Maximum	81
Range	60
Interquartile range (IQR)	16

Descriptive statistics

Standard deviation	11.78642311
Coefficient of variation (CV)	0.3561875193
Kurtosis	0.8263829494
Mean	33.0905
Median Absolute Deviation (MAD)	7
Skewness	1.181267223
Sum	66181
Variance	138.9197696
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
22	192	9.6%
21	166	8.3%
25	134	6.7%
24	122	6.1%
23	103	5.1%
28	98	4.9%
26	84	4.2%
27	81	4.0%
29	70	3.5%
31	58	2.9%
Other values (42)	892	44.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
21	166	8.3%
22	192	9.6%
23	103	5.1%
24	122	6.1%
25	134	6.7%

Value	Count	Frequency (%)
81	3	0.1%
72	3	0.1%
70	3	0.1%
69	6	0.3%
68	3	0.1%

Outcome
Boolean

Distinct	2
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	15.6 KiB

0	1316
1	684

Common Values
Chart

Value	Count	Frequency (%)
0	1316	65.8%
1	684	34.2%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

First rows

	Pregnancies	Glucose	BloodPressure	SkinThickness	Insulin	BMI	DiabetesPedigreeFunction	Age	Outcome
0	2	138.0	62.0	35.0	NaN	33.6	0.127	47	1
1	0	84.0	82.0	31.0	125.0	38.2	0.233	23	0
2	0	145.0	NaN	NaN	NaN	44.2	0.630	31	1
3	0	135.0	68.0	42.0	250.0	42.3	0.365	24	1
4	1	139.0	62.0	41.0	480.0	40.7	0.536	21	0
5	0	173.0	78.0	32.0	265.0	46.5	1.159	58	0
6	4	99.0	72.0	17.0	NaN	25.6	0.294	28	0
7	8	194.0	80.0	NaN	NaN	26.1	0.551	67	0
8	2	83.0	65.0	28.0	66.0	36.8	0.629	24	0
9	2	89.0	90.0	30.0	NaN	33.5	0.292	42	0

Last rows

	Pregnancies	Glucose	BloodPressure	SkinThickness	Insulin	BMI	DiabetesPedigreeFunction	Age	Outcome
1990	3	111.0	90.0	12.0	78.0	28.4	0.495	29	0
1991	6	102.0	82.0	NaN	NaN	30.8	0.180	36	1
1992	6	134.0	70.0	23.0	130.0	35.4	0.542	29	1
1993	2	87.0	NaN	23.0	NaN	28.9	0.773	25	0
1994	1	79.0	60.0	42.0	48.0	43.5	0.678	23	0
1995	2	75.0	64.0	24.0	55.0	29.7	0.370	33	0
1996	8	179.0	72.0	42.0	130.0	32.7	0.719	36	1
1997	6	85.0	78.0	NaN	NaN	31.2	0.382	42	0
1998	0	129.0	110.0	46.0	130.0	67.1	0.319	26	1
1999	2	81.0	72.0	15.0	76.0	30.1	0.547	25	0

Most frequent

	Pregnancies	Glucose	BloodPressure	SkinThickness	Insulin	BMI	DiabetesPedigreeFunction	Age	Outcome	count
146	2	81.0	72.0	15.0	76.0	30.1	0.547	25	0	6
48	0	173.0	78.0	32.0	265.0	46.5	1.159	58	0	5
148	2	83.0	65.0	28.0	66.0	36.8	0.629	24	0	5
259	4	125.0	70.0	18.0	122.0	28.9	1.144	45	1	5
308	6	154.0	74.0	32.0	193.0	29.3	0.839	39	0	5
330	7	195.0	70.0	33.0	145.0	25.1	0.163	55	1	5
3	0	84.0	82.0	31.0	125.0	38.2	0.233	23	0	4
15	0	102.0	64.0	46.0	78.0	40.6	0.496	21	0	4
30	0	126.0	84.0	29.0	215.0	30.7	0.520	24	0	4
36	0	135.0	68.0	42.0	250.0	42.3	0.365	24	1	4

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows

Duplicate rows

Most frequent